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ABSTRACT 

In a series of three independent studies (focusing respectively on . 
the classic sources of curriculum: the learner, society and subject matter) 
data were gathered that might bear on the choices facing the curriculum 
developer. Data from the learner tentatively revealed what characteristics 
of pictures affected the deployments of third grade children ' s visual atten- 
tion. Data from the society /^ovided increased awareness of the structure^ 
and direction of a group ©"^mothers' goals ^or their infants. Subject 
matter data from an expert^udge provided^jiseful suggestions for the organi 
zation of content for a preschool mptor curriculum. In each of these studies, 
polynomial conjoint scaling, a form of multi-dimensional scaling, reduced a 
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complex matrix of data to % simple visual display which was useful to the 
curriculum developer in his decision' making process. . 
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.Conjoint Scaling as a Decision 
Aid in Curriculum Developiaent 

Joseph J. Sparling, Frances 'A. Cfinpben, 
Grace W. Templeton and E. Janice Wh^elori 

- ' ■ ^ • ■ . •/ 

Obj ectives . Frequently the sources from which curricula flow (the value 
judgements,, the. assumptions, etc.), remain hazy and inaccessible to both the 
fcurriculu]u devedoper and the curriculum user . There are perhaps many., reasons 
why we, as curriculum developers, typically ha.ve not documented the-^sources 
or' forces which affect our decision making. Chief among these ijiay' be that 
curriculum users have not demanded this, information. But consumerism is an 
idea whose time has come for curricula as well as for foods and automobiles. 
'Today it is appropriate to supply the curriculum user with' not only test 
results on the effects* of the curriculum b'ut also to supply information on . 
the curriculLim sources.. .This additional information may be analogous -to 
supplying o.n.the label on a food package not only the fact that it contains 
X grams of protein but that its source is vegetable protein rather than animal. 

The purpose of this paper is to illustrate one procedure for'clarifying 
^and extracting useful information from curriculu]?. origins or sources. Such 
pro.cedures can help the curriculum developer to do^his 6x her work at a, 
higher level of awareness and when the product is ready for dissemination to 
describe it (provide tl r' fine print on the label) more adequately. 

Theoretical' framework . The theoretical position of Ralph Tyler (1950) identified 
the classic sources of curriculum as 1) the learner, 2) the society, and 3) the, 
subject matter. This research took each of these sources in turn and through 
a single meth'odology e;.:plored the problem of analyzing information so that it 
could inform the decisions of the curriculum developer. ' 



Data sources. Data were gathered from three independent sources, representing 
respectively the learner, the society and the subject matter.?- The population - 
representing, the le.amer were 15 public school third gracle males in Chapel Hill, 
N.C. >The ^population representing opinions of one particular strata of the society 
was made up' of the mothers (27 total) of two cohorts of high risk infants 
enrolled in an early intervention program of the Frank Porter Graham Child 
Development Center, Subject matter was repres^ted by a kindergarten teacher 
from the Frank Porter Graham Center acting as an expert judge. in each case, the 
data represent an interim report. Additional data are being gathered- as a con- 
tinuirxg refinement of input in the on-going curriculum development decisions..-- 

•^It would have been informative .to have coLlected dat afr-eirf'the^^ sources 
wiiiiiii a..siiigltj curriculum project . However^J^jja-ee'^this was not possible' within 
t«he on-going projects of the authors ,^j)^e_,Ghoose to illustrate the three curriculum 
sources from three separate studi-esT' 



Metliods . In each of the three area^ of "this study, data were, gathered that 
might bear on the choices facing the curriculum developer. The data were 
analyzed in each case using polynomi.al -conjoint' scaling. (Young, 1975), a form., 

, of miiltidimension^rl scaling. The folloiv^ing sections describe in turn the 
application to each area. It is not the purpose of this paper to fully describe 

.each as a complete study with detail adequate for replication. [Te.mpleton (1975) 
supplies this amount of detail on the -methodology of the first study J"^] Rather 
than dealing with the methodology per se , the -following sections will give * . 
attention to the usefulness of the methods as" an aid in the decisions of the 
curriculum developer. 

'■ ■ \ ' * • . • 

IVhat properties of information can cluud the decision making of the 
curriculum developer? First there is information which contains imbedded 
hypotheses. This may be especially true for information regarding the learner. 
The curriculum developer may find that most or all the available research 
findings bearing on a decision he- or she faces is unduely limited by the 
hypotheses of the original investigators. This was the case in the investigation 
which follows under the heading the lea'jrner. Conjoint scaling was of aid in 
this instance by providing a metho*^dology for generating rather than confirming 
Hypotheses. 

A second quality of information which may concern. the curriculum, developer 
is complexity. For example, value judgements or perceptions may exist in such 
large numbers -that they are difficult if not impossible to deal with directly. 
And since individuals make their value judgements simultaneously on several 
bases, a simple one-dimensional scaling of the judgements/ is often inadequate, 
'The second and third" investigations wliich follow imder the respective headings 
of the. society' and the subject' matter illustrate the usefulness of conjoint 
scaling as. a method of reducing a complex matrix of relative judgements of 
curriculum. geals to a simple physical picture which interrelates the goals as 
points in an n-dimensional space.: 

■ T ' ' , . ■ ■ ■ 

The Zecomei\ In designing pictorial material for children the curriculum 
developer' naturally turns to t_he .substantial research, literatui'^ on children 's' 
visual attention and picture preference. A brief review of one of the best o£ ' 
these studies illustrates the problem facing the curriculum developer. Stewig 
(1974) asked 1,078 elementary school children to indicate ' their preference, in 
pairs of pictures (slides). The, pictures were varied. on five visual components 
with only one variable manipulated at a time. The following combinations were 
used; (1) color very realistic versus color highly unrealistic; (2)'^.shape 
defined as very flat objects versus modeled shapes presented in. three-dimensional 
quality; (5) very realistically proportioned objects versus objects having very 
exaggerated proportions; (4) many details versus few details; and (5) very flat ' 
picture plane (space) versus very deep space.' The results are very significant . 
to the curriculum developer who agrees that the five visual components are, in 
fact, the salient ones. For the curriculum developer who disagrees or who suspects 
a complex interation of visual components, t lis and, most other studies provide 
little/help . ' 



.. '. ■ > ■• 

To' avoid the problem of inadequate hypotheses, the present study displayed 
all possible pairs (190) of twenty pictures randomly selected from children's 
literature and recorded ,hoK the subject divided his time for each pair. The 
data^ a dissimilarity score for each pair of pictures^ were analyzed , through ; 
conjoint scaling which generated in an n-dimensional space an array 26 points 
representing the 20 pictures . ' Cliff and Young (1968, ,p . 270) in describing the 
benefits of this general method of analysis state that "....methods for multi- 
dimensional scaling provide much more useful ways of determining the subjective ' •• 
organization underlying the individuals reactions [to a set of stimuli] " than 
was possible in the past . . . • The individual- has , so to speak, a psychological 
map. of the stimuli, nnd he uses it in various ways J' 

. The points and the space generated through. conjoint scaling of the responses " 
of children to the pairs of pictures in this study may be- thought of as analogous 
in. some sense to the average psychological map .those children use as a reference 
whenever they have to deal with the pictures. Dimensions or vectors within .the 
space may be assumed to be analogous to broad characteristics (such as color, ' . 
complexity or subject matter) which may have .affected the children's visual 
attention. .Thus clustered pictures have similar attractiveness and perhaps 
similar characteristics while pictures widely spaced have differential attraction 
and characteristics. By examining and interpreting the physical array the 
curriculum developer takes the initial steps in sorting, out the elements he will 
attend to in designing pictorial material for children. The following paragraphs 
illustrate the inteipretations.. 

One of the many arrays produced in this study is shown in Tigure 1 .. Each 
block in the three-dimensional space represents a particular picture as perceived 
by a sample of 15. eight-year-old white males. The fact that the pictures with 
feminine content fell mainly on one side of the space while masculine content • 
pictures- fell on the other strongly suggests that this masculine-feminine 
attribute! was one of the bases on which the males divided their attention. ' The 
importance of this interpretation is underlined by the fact that masculinity/, 
feminity of content has hardly been mentioned let alone studied in the vast 
majority of picture preference studies. 

Other smaller clusters in the three-dimensioiial array have narrower inter- . 
pretations. Figure 2 shows the proximity of three pictures each of which had 
red-, white and blue as dominant colors. Figure 3 demonstrates the relationship 
of the only two pictur.^s of the. '20, which were rendered totally in black and white. 
Figure 4 might be labeled the cartoon style cluster. However, these three pictures 
demonstrate how several features may -tend to appear in tandem in the real world 
of children's materials. Traits shared by these pictures were: (1) each had a 
cartoon-style appearance, (2) each picture contained one animal, and. (3) each was 
renrler.prl in one subdued color combined with black, white and 'gray . The pictures 
in a final cluster. Figure 5, seemed each to have, a predominantly blue color and 
the content of each could be interpreted to have a threatening, aspect. 

^The masculine/ feminine interpretation was originally the researcher's but was 
later confirjiied hy ratings of seven expert judges.. 
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Figure 3 
Black and V/hite 
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' Figure 4^ 

Cartoon Style Cluster 
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The physical proximity on the plot of the members of each of these 
clusters suggests that the points are close to each other in the average 
child's psychological map of the pictures. In theory, the nearer two points 
are on a psychological map, the more nearly they are perceived to be alike 
in their attractiveness and/or their attributes, nierefore, it may be assumed 
that any choice (such as choosing what to look at) between points "that are in 
close proximity would represent a more subtle decision than a choice between 
.distant points. 

Yhis study represents an on-going initial planning phase for the develop- 
ment of pictorial curriculum materials . Sex and age of subjects- will be 
varied in the next phases. Conjoint scaling is aiding the curricul m devel- 
oper in freeing his decision making from the constraints 'of earlier studies. 
This creates the necessity for- doing a substantial amount of basic ground work, 
but that seems a better use of time than concerning oneself with, for example, 
pictorial depth of -field when pictorial content nay be the variable of over- 
riding importance.. jv 

^ society . It is presujnptious if not arrogant to design '^intervention*' 

'programs^, for young children j;ithput learning about the aspirations and goals 
the, parents hold for their diildren'.; - However, the- task of clearly stati-ng 
'"^ one's, goals may be difficult for anyon,e and doubly difficult for parents v;ith 
' modest verbal ^ facility . To help parents, formulate and communicate their goals 
in a longitudinal program^ tor' high risk infants, several' sets of picture cards 
^ v/ere devised. One- set of cards illustrated 12 varied developinental tasks 
which most children achieve 'at. 24 months of age; a second set villus trated 12 

tasks typically achieved a^ 36 months of age. The tasks were selected to 

cover the widest po'sis^ible range of social, motor^ cognitive and language 
behaviors.-^ in additiorf- to a photography each card had a verbal description 
of the task. ForAe-'^ample, the words- "Uses cup and spoon .neatly." and an 
■ appropriate -picture appeared on pne^bf the 24 nonth cards. 

When a child in t'he program reached 12 months of age, the-^paren^ was 
. -asked to think ahead to the "time Vhefl the child would be 24 months of age. 

The mother was then given the set of cf|,rd.s for 24 months and asked to r'ank 
' orde'r them in terms of which tasks we^-p the most impoi^tant ^oals for her 
cKild> Likewise, a year bef^e her child reached 56 months of age, the 
mother was asked to show through ranking the relative importance she placed 
on' the various 56 month tasks or goals. These rankings, analyzed through 
conjoint scaling, provided and continue to provide an important parent 
input to the curriculum devleopment team of the intervention project. 

A two-dimensional array" of the 24 month developmental goals (Figure 6) 
showed the curriculum developers that the parents valued certain motor goals 
(£ '''Balance on one foot", ^ *'Crawl backward downstairs", £ "Scribble witfi a 
, crayon"J to a simila.r degree. * *. • 



^Random selection of the tasks would have been ideal, but it was found that' 
many tasks were difficult to illustrate. Some investigator bias was accepted 
in order to minimize the ambiguity in the illustrations. 
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Figure 6 



Twenty-Four-Montli Developmental Goals, 
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Two" othQi\clusters were distant and therefore distinct from the motor cluster. 
These coulUbe labeled language (N. "A^k names of things", £ '*Get something and 
bring, it to >k)u", H "Say hi to people he-"knows")and social independence (IJ "Use 
cup and spoon neatly", P "Use potty chair"} . Not only did these 16 mothers value 
these language goals and social independence goals to a similar degree, their pre- 
ference was in this direction/ This infonriation reminded the curriculum developers 
■of the practical importance of independence to mothers, especially in homes 
with many social stresses. The mothers'- perception of language ''goals provided 
a happy congruence with the curriculum developers' biases and provided support 
for an increasing emphasis in language programming. 

The curriculum developers were surprised. to see in/tjfe 36 month goals 
(Figure 7) a favored cluster which might be described as School-like goals 
(A "So£jL things that l.'ook alike",. T "Tell something he has seen or done", 
£ "Know what 'one '_ means", B "Build a house with blocks"); The cognitive/language 
emphasis^ of the" school;^ike cluster provided some assurance that the parents 
(11 mothers) and the /curriculum developers, were in substantial agreement'^-for 36 
month goals, k lack of such agreement might have signaled the need for additional 
two-way comihunication and goal clarification between the Center and the parents. 

' - • , V - ^ ■ 

The subject matter '. As a first step in generating a kindergarten motor 
development • curriculum, the literature was searched for goal statements on the . 
subject .matter or content of motor development progra:ms. .From these statements ; 
15 were selected as ^representing, a dispursed- and heterogeneous set. The plan for" 
this study is to obtain feedback from judges who are expert on the age level 
(kindergarten teachers) .and judges who are expert on motor developnient (physical 
education teachers) and to individual ly^analyze . each judge's response. .Individual 
scaling solutions are possible since each judge^is asked to make' not one but 15 
rank orderings of. the content statements using each statement in turn as a reference 
point an^judging the remaining statements in. terms of their similarity to tlie 
referent."^ - . ^ k 

Reported i?i Figure -^- is--ihe_t_wo-dimensional conjoint scaling output for the* 
first kindergarten judge. One distinct cluster contain'gd"^7r ie of ■l- h e-mo-re-phy5l-&al— 
of the traditional physical education "goals (J "Speed/agility",. £ "Reaction time", 
-E "Endurance", £""Strength") . ^ ~' For this kindergarten teacher a second set of 
goals which seemed to rel^lte movement: to other fields and^to general learning 
(A "Alternative approach", JL "Basis for development", G "Goal directedness", I_ 
"Individual solutions"), was maximally distinguished from the more phys^i cal , goals . 
Intermediate between'\hese two clusters was a group of three goals (H '"Hand-eye 
coordination", JD "Bi-lateral dominance", N "Learning disabilities") which seemed 
to relate to learning problems or disabilities. - '\ 

The perception£v.pf this kindergarten teacher have provided the curriculum 
developers with an initial insight into subject matter organization. For example. 



•'•The goals, of course, were stated in detailed sentence form, key words only are 
provided , he re. ' > , ' ? 



Figure 7 ■ 
Thirty-Six-Month Developmental Goals 
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• Figure 8 . ' ■ 
Content Goals for a Kindergarten Motor Development Curriculum 



■ ROUTFD CrNFir.yiUlIGH. DIHFNSIO^ 1 (X-AUSI VRS-JS DIMENSION ? lY-AXiS) ' ' " 

. ^IMi. -1.J500. -O.T5D0. ! •0,'^^0(). • -0.1500. O.lSnO. 0.;50p. OJ500. 1.0500. , USOO, ^ 
' -1.50C0 "1*2^ -0.9000 -0.6000 -0.3000 O.OCOO 0.3DOO. 0.6000 0.9000 l.ZOOO ' i-5000 



< 

I.?!) < 

i.;'o M 

1.15 * 
1. 10 

"1.05 . 

L.Ofl ♦ 

n.«)5 " ■ 

0.(15 * 

O.BO » 

D.75 . 

0,70 » « 

d.SO 

(r.55 » 

0.!>0 » .„ 

o.^§ . 

0.41 • 

0.35 • 
J. Ill 

0.i!0 « 

'0.1!) .'• 

O.LO ♦ 
O.O'j. " 

o;i]^ ■ * 

0.L5 . 

o.?o • 

O.JI) o , 

o.b * 

o-..^.^ 

0.50 • 

O.ili') * 

0i60 .. 

Oiio'i » 

6*T0 *■ 
0.75%? 
0,80 

0. 90 

ttoo 
i\io 

1.15 

1. ?0 
1p25' 
1.30 
1.35 




/ I 



\l Legeiyl 



— ^- General Learning 

Disabilities 
— - Physical 



n = M^ndeirgarten teacher 



■if 



1.35 
lOO 
l.?5 
1.20 
1.15 
1.10 
1.05 
1.00' 
0.95 
0.90 
,0.fl$ 
b.B3 
0.,?5 
0.70 
M\ 
O.iO' 
0.55 
0.50 
0.45' 
O.^O 
0.35 
0.30 

0. 25 

01. 'O 
0.15 
6.10 
0.05 

-0.00 

-3.05 

'0.10. 

-0.15 

-0.?0 

0.?5. 

-0.30 

-0.35 

-0.^0 

-0.45 

-0.50 

-0//j., 

-0.6O 

•0.65 

-0.70 

-d;75 

-D.OO 
-0.35 
-0.90 
•0.95 

-troo 

•i.D,5 

-i.io.. 

•1.15 . 
*l.?0 
•1.25 
-1.10' 



• ,*M*,MM,MM,Mi*.MM,ilM,Oi^MM,MM;*M^MM.M*4,MM,MM,MM,M*|y*M4,MM,tM»,IM*,l 

■ ' . ^-L.15. 'Jir;-^-l.0500. -0.7510. •(.:0.'^500. .-O'.-ISOO. . 0^1500. 0.^500. 0.7500." " ^ U500. 1.35flfl. ^! 
•1.5000 'Um .-0.0000 .-0.6,00.5^ -Q.300O 0.0000 0.3000' 0;-6000 — O.;0000--J^ 



the strong separation or dissimilarity seen between physical and general learning 
goals alerts the curriculum developers that they may have to choose between 
accepting this split or making a major effort in the curriculum material to 
integrate the two areas. As the opinions of different judges are gathered the 
curriculum developers can move forward in establishing a subject matter • 
organization plan. , • 



Conclusions , Systematic methods of dealing with information from the traditional 
curriculum sources can contribute to the work of the curriculum , developer . ■ Multi- . ■ 
dimensiortal' scaling. .provides one methodology with broad utility in this area. 
In the. three examples given, the curriculum developers will be able to describe 
their completed products with some degree o,f confidence about, their sources. In 
the first instance, the developer~will be ible to state that the pictoral materials . 
that are eventually produced are designed t:»o have* qualities that are kno\m to 
influence the attention of the' selected leaders. In the second instance, the 
developer will be able' to say that the ~infarit curriculum, goals have conf ligation "\ 
from the parents or society to be served, In^.the final instance, the developer 
will-"be able to say that certain aspects of the subject matter organization of : * 
the motor curriculum were influenced by teachers and -certain aspects ..were influenced 
•by physical education experts. This type of information on the curriculum . 
sources would make a welcomed addition to the description of any^ curriculum product • 



Educational^" importance , Increasing sojphistication of curriculum- deyelopeo^s and 
curriculum users requires that the processes and, decisions inv curriculum develop- 
ment become more overt^..'- The procedures used in these studies demonstrate the ' 
usefulness of one psybhomQtric tool in illuminating some of the most basic 
curriculum development decisions. l\rhen the sources of the curriculum are apparent, 
.potential curriculum users can more intelligently exercise 'their om, options . . 
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